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Abstract 

Generalizing Krieger's finite generation theorem, we give conditions for 
an ergodic system to be generated by a pair of partitions, each required 
to be measurable with respect to a given sub-algebra, and also required 
to have a fixed size. 

1 Introduction 

Let (Z, Tz, £t) be a probability space, and let T : Z — > Z be a measurable, 
probability preserving transformation of Z. If fi is ergodic with respect 
to T, we say that (T, Tz , H,T) is an ergodic system. 

A partition P of Z is called generating if the sigma-algebra generated 
by V^°oo T l P and the sigma-algebra of null and co-null sets is equal to 
Tz- If P has a parts, then for any \j T 8 P-measurable partition Q, the 
entropy h(T, Q) is less than or equal to log a. Hence, if h(T) > log a, then 
there are no generating partitions with a parts. In [J, Krieger proved the 
following partial converse: 

Theorem 1.1 (Krieger). Let (Z, Tz, fJ-,T) be an ergodic system, and let a 
be an integer such that log a > h(T). Then there is a generating partition 
P of Z that has a parts. 

The case where h(T) is equal to log a is different; there is a unique 
ergodic system for which there is a generating partition with a parts 
(namely, the Bernoulli system). 

Krieger's theorem can be thought of as an infinite version of Shannon's 
coding theorem for noiseless channels. In Shannon's theorem the block 
size is finite and the error remains positive but converges to zero as as the 
size of the block grows. Shannon's theorem for more general channels was 
also given a zero error version using inifinite codes, as is usual in ergodic 
theory in a series of papers including [2] and [3] 

In information theory there is a surprising extension of Shannon's cod- 
ing theorem to correlated sources due to Slepian and Wolf, [B] . Our main 
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result is a zero error version of the Slepian-Wolf result for noiseless chan- 
nels. Combining the techniques of Kieffer with those of this paper would 
lead to a zero error version of the Slepian-Wolf theorem in the context of 
noisy channels, but we leave these extensions for the future. 

In order to describe the result, consider the following scenario: Suppose 
that Tx , Ty C Tz are sub-sigma-algebras and that Tz — Tx V Ty 
(without loss of generality, we may assume that Z — X x Y is a product 
space, and that Tx,Ty are the corresponding sigma-algebras) . We seek a 
pair of partitions Px , Py such that Px is ^-"x-measurable and has a parts, 
Py is .TV-measurable and has b parts, and the partition Px VPy generates. 
There are three necessary conditions for such partitions to exist: the first 
is that the conditional entropy of T with respect to Ty , which we denote 
by h(T\Ty)t is less than or equal to log a, the second condition is that 
h(T\Tx) < logfr, and the third condition is that h(T) < log a + log b. As 
in Theorem ll.il we show that these conditions are almost sufficient: 

Theorem 1.2. Let (Z, Tz ,m,T) be an ergodic and probability preserving 
system, let Tx,Ty be invariant sub-sigma-algebras of Tz, and let a and 
b be integers. Assume that log a > /i(T|JV), that log 6 > h(T\Tx), and 
that log a + log b > h(T). Then there are partitions Px and Py of Z such 
that 

1. Px is measurable with respect to Tx and has a parts. 

2. Py is measurable with respect to Ty and has b parts. 

3. Px V Py generates the sigma-algebra Tx V Ty. 

More generally, it is straightforward to generalize Theorem 1 1.2 1 to the 
case of n partitions. Namely, assume that there are n sigma-algebras, 
Ti, ■ ■ ■ , T n , and n integers a%, . . . , a n . If for every non-empty subset S C 



then there are partitions Pi, . . . , P n such that Pi has a, parts and is T- 
measurable, and that Pi V ... V P n generates. 

The proof of Theorem 11.21 is given in Section |4j and consists of two 
parts. In the first part (Proposition 14 . 2 1! we show that there are partitions 
Px , Py that satisfy the first two requirements, and such that the partition 
Px V Py is close to being a generating partition (in the sense that the 
sigma-algebra generated by it contains a partition which is close to a fixed 
generating partition of Z). This is done by a procedure of 'painting names 
along Rohlin towers'. In the second part (Proposition I4.4 |l we show that 
one can slightly change these partitions and get partitions that are even 
closer to being generating. The proof of Proposition l4.4l uses the procedure 
of 're-painting names along Rohlin towers'. Applying Proposition 14.41 
inductively, we get a Cauchy sequence of partitions that converges to a 
generating partition, which proves Theorem 11.21 

The procedures of painting and repainting along Rohlin towers are 
explained in Section [3] Finally, Section [2] contains several auxiliary re- 
sults, the important one is a corollary of the Shannon- McMillan theorem. 
No novelty is claimed for this material; it is assembled for the reader's 
convenience. 
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2 Preliminaries 

Definition 2.1. Let (Z, Tz , (J-,T) be an ergodic system. 

1. A (Rohlin-) tower is a pair T = (A,M), where A is a subset of Z , 
and M is a natural number, such that for any < i < M, the sets 
A and T" A are disjoint. 

2. If T = (A,M) is a tower, the set A is called the base of the tower, 
and is denoted by bT ; the number M is called the height of the tower, 
and is denoted by \T\. 

3. If e is a real number, we say that a tower T = (A, M) covers more 
thane of Z if fj,(A U TA U . . . U T M ~ X A) > e. 

4- IfQ is an invariant sub-sigma-algebra, we say that T is Q -measurable 
if A is Q -measurable. 

Definition 2.2. Let (Z,Tz,li,T) be an ergodic system, and let k be an 
integer. A partition of Z into k parts is a function P : Z — > {0, . . . ,k — 1}. 
Given a partition P into k parts, we denote the number k by \P\. 

Definition 2.3. Let (Z, Tz, (J>,T) be an ergodic system, letT — (A,M) be 
a tower, and let P be a partition of Z . For every z G A, the (T,P)-name 
of z is the tuple (P(z), . . . , P(T M ~ 1 z)). We denote the (T,P)-name of z 
by u r ,p(z). 

For a proof of the following theorem, see [5] . 

Theorem 2.4. Let {Z,Tz,[i,T) be an ergodic system, let f : Z — > C be 
a bounded function, and let P be a partition of Z . For every e > there 
is a natural number N such that if T is a tower of height greater than N 
that covers more than e of the space, then 

1. The set of points z in the base ofT that satisfy 



has measure greater than (1 — e)fi(A). 

2. There is a collection JV /2 ( ' l(z " p)+<!)|r| elements in |P| |r| such that 

(a) For every n — (m) G N , the measure of the set of z's in A 
whose (T ', P)-name is equal to n is between 2 - ( h ( z ' p ) +6 )l T l and 



(b) The measure of the set of z's in A whose (T, P)-name is in M 
is greater than (1 — e)/j,(A). 

Definition 2.5. For a partition P, define Np to be the set of words of 
unspecified length with entries in {0, . . . , |P| — 1}. 

For a set fi, we denote by 2 n the collection of finite subsets of Q. 
Corollary 2.6. Let (Z,T) be an ergodic system, and let P,Q be two 
partitions of Z. Denote the sub-algebra Vt-oo T l P by T . For every 
e > 0, there is an N such that ifT — (A, M) is a tower of height greater 
than N that covers more than e of the space, then there is a function 




2 -(h(Z,P)-e)\T 



& : Np 




such that 
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1. For every z £ A, the set $>(v T ,p{z)) has less than 2 |T|(/l(T ' Q| - F)+,!) 
elements. 

2. The set of z's in A such that <&(ut,p(z)) contains the (T,Q)-name 
of z has measure greater than (1 — e)fi(A). 

Proof. By Theorem 12,41 if TV is large enough, then there are collections 

A/"C|P| |T| A4c|PxQ| |r| 

such that for any n £ A/\ the measure of the set of points whose (T, P)- 
name is equal to n is less than 2~' T ' ( - h< - T ' F ' ) ~ e - ) , for every m £ A4, the 
measure of the set of points whose (T, P x Q)-name is equal to m is 
greater than 2~l r K' l ( T ' Px( 3)+ E ' l and the set of points whose (T, P)-names 
are not in M or whose (T, P x Q)-names are not in A4 has measure less 
than efi(A). 

Let 7Ti : \P x Q| |T| |P| |T| and tt 2 : \P x Q| |T| -> |Q| |T| be the 
co-ordinate projections. Let n £ A/p. li n €J\f then 

2 -|r|( M T,p)-e) > m{2 e AWt Pxq{z) 6 , r i (n)nA1} > | 7ri - 1 ( n )nA4|2-l r '( h ( T ' PxQ » + ^ 

and so ^(nJnA^I < 2 |T|(h(T ' Ql ^ )+2e) . Define $(n) = ^(tt^^ti) n M) 
if n G N , and $(n) =$iin£N. □ 

We will use the standard notation for the entropy function: H(x) = 
x log 2 (x) + (1 — x) log 2 (l — x). The following is well known. For a (much 
more) general statement, see [l] Theorem 3.9]. 

Lemma 2.7. Let P be a partition, let Q be an invariant sub-sigma-algebra, 
and let T — (A, M) be a Q-measurable tower that covers more than 1 — e 
of the space. If there is a Q-measurable function $ : A — > 2 Afp such that 
the number of elements in &(z) is less than 2 ,l ' T ' and the set of z £ A 
such that vt,p(z) £ $(2) has measure greater than (1 — e)fi(A), then 
h{T,P\G) <h + H(e) + 2e\P\. 

Definition 2.8. Let P, Q be partitions of a probability space (Z, fi). Define 

\PAQ\ = ii{z £ Z\P{z) + Q{z)}. 

Definition 2.9. Let P be a partition, let A be an algebra of sets, and let 
e > 0. We write P C A if there is an A-measurable partition Q such that 
|PAQ| < e. If Q is a partition, we write P C Q if P C Aq, where Aq is 
the algebra generated by Q. 

The following lemma is evident: 
Lemma 2.10. Let Pi,P2,Ps be partitions of a probability space Z. If 
Pi C Pi and P 2 C P 3 , then Pi "'c P 3 . 

Proposition 2.11. Let (Z,T) be an ergodic system, and let P,Q be par- 

5 

titions of Z . Assume that P C V^oo T l Q. Then for every e > 0, there is 
an K , such that for every tower T — (A, M), which covers more than e of 
the space and for which M > K, there is a function $ : A/q — + 2 Afp such 
that 
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1. For every z € A, \^(ut,q(z))\ < 2 (H ^+ S ^+^ M . 

2. The set of z G A such that vt,p{z) £ $(Vt,q(2)) has measure greater 
than (1 - e)n(A). 

Proof. By assumption, there is a number N, and a function <f> : \Q\ 2N+1 — > 
\P\ such that the set 

B — {z £ Z\<t>(Q(T- N z), Q(T N z)) = P(z)} 

has measure greater than 1 — 5. Let 77 > 0, to be chosen later. By Theorem 
12.41 if T = (A, M) is a tower that covers more than e of the space, and M 
is sufficiently large, then the set of z £ A such that 

\{0Zi<MF>,eB}\ 

M " 

has measure greater than (1 — e)fj,(A). If we require in addition that 
N < rjM/2 we get that for those z's, 

\{N<i<M -N\T<zeB}\ 

M ( w 

Define tp : \Q\ M -> \P\ M by 



V>((«0)i 



U( qj -. N ,„ . q J+N ) UN<j<M-N 
\ else 



For (qij) G |Q| M , let $((©)) be the set of elements in \P\ M whose 
Hamming distance from tp((qi)) is less than [rj + S)M. The size of $((g0) 
is less than 

which is less than 2W <5 ) +£+,5 l p " JU if 77 is taken small enough. Moreover, 
for every z that satisfies vt,p(z) G $(it,q(2)). d 

We end this section by the following lemma, which should be thought 
of a relative version of the claim that if / is a random function from a 
set of size a to a set of size b then the non-empty fibers of / have size 
l + 0(a/b). 

Lemma 2.12. Let {Z,Tz,\T) be a probability space, and let be a finite 
set. Assume that </> : Z — > <& : Z — ► 2 n are functions such that < 
a and <j)(z) £ $(z) for every z £ Z . The probability that a random function 
ip : Q — > [6] satisfies that 

fi jz g zilir 1 ^*))) n *(*)| <i + i(«)|> 1 _vz (2) 

is greater than 1 — 
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Proof. Let B be the complement of the set in ((2}. Then 

Efi(B) — [ Pr(z£B)dz = f Pr(|^~ 1 (V'(0(2)))n($(2)\{< ? !.(2)})| > a/eb)dz. 
J z J z 

Since the restriction of tp to $(2) \ {(f>(z)} is independent of if)((j)(z)), 

E\1>- 1 MKx)))nm*)\{<K*)})\ = %, 

and hence the integrand is smaller than e. This means that E/i(£?) < e, 
which implies the claim. □ 

3 Painting and Re- painting 

From this point on, fix an ergodic system (Z, Tz, T). All partitions are of 
Z and all sigma-algebras are contained in Tz- 

Definition 3.1. A •partition P is called l-admissible, if there is no z G Z 
such that P(z) = P(Tz) = . . . = P(T £_1 2 ) = 0. 

Definition 3.2. An l-admissible sequence of length n on a symbols is 
a sequence in {0, . . . , a — 1}" whose first element is 1, and that does not 
contain a segment of consecutive 's of length I. The space of l-admissible 
sequences of length n on a symbols is denoted by A(n, I, a). 

The following lemma is evident: 

Lemma 3.3. For every t, if I is big enough, then linin^oo — log \A(n, I, a)\ > 
log a — e. 

This lemma will ensure that we can use the symbols and 1 to mark 
the base of the tower and still have enough names for encoding. 

Definition 3.4. Let {Z,Tz,^,T) be an ergodic system, and fix a gener- 
ating partition P. Let T — (A,M) be a tower, let I < \T\ be an integer, 
and let a > 2 be an integer. 

1. A (T , I, a) -painting data is a function 

<t> : |P| |T| -> A{\T\- l,l,a). 

2. A painting data (f> induces a partition Q given by 

( 4>(u T p(T- t z)) l T^z G A and < i < \T\ - I - 1 

Z I — > x 

[ else 

Lemma 3.5. 1. For every tower T, and every (T, I, a) -painting data (j> 
that generates a partition Q, the base ofT is measurable with respect 
to T*Q. 

2. Suppose that h(T) > log a and let e > 0. There is e' > such that if 
I is big enough, T is a tower that covers more than l—e' of the space, 
and \T\ is big enough, then the probability that a random (T,£, ap- 
pointing data tp that induces a partition Q satisfies that h{T, Q) > 
log a — e, is greater than l — e. 
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Proof. The first claim follows, from the fact that z £ A if and only if 
P(z) = T and PiJ^z) = . . . = P { T~ k z) = 0. 

As for the second claim, let e < e be such that 2e'|P| +H(e) < e, and 
assume that T covers more than e' of the space. By Theorem 12.41 there 
is a collection M of less than 2 (,l(T)+e )|T (T, P)-names such that the set 
of z £ A for which ^t,p(z) £ A/" has measure greater than (1 — e')/j(A). 
Applying Lemma 12.121 to the functions &(z) = N and ut,p(z), we get 
that the probability that 

fj,{z\\Af n^^fi/r.pfz))! < 2 ( h ( T >- log£l + E ')l T l} > 1-e' 

is greater than 1 — e'. In this case, since z h Affl tf)^ 1 tl}(i/T,p{z)) is 
VT^Q-measurable, Lemma [2~7l says that h(T| XJTQ) < h(T) -loga + 
2e'|P| + H{e) < h(T) - log a + e, which implies the claim. □ 

Definition 3.6. Let (Z, Tz , fJ-,T) be an ergodic system, and fix a gener- 
ating partition P. Let P be a partition of Z, let T — (A, M) be a tower, 
let £ be an integer, and let e > 0. 

1. A (T , P,£,e) -repainting data is a function 

<j>: |P| |T| ^A(e\T\,£,a). 

2. A repainting data induces a partition of Z given by 
z f T 



z i — > < 



P(z) T-^-z £ A, e\T\ <i<\T\-2£ 

4>(rsT,p(T- l z)) t T~*z £ A, < i < e\T\ 

T^z £ A, \T\ -2l<i< \T\ 

Lemma 3.7. Let P be a l-admissible partition, let T be a tower that 
covers more than 1 — r\ of the space, and let (j> be a (T , P, I, e) -repainting 
data with associated partition Q. Then |PAQ| < e + 77. 
Lemma 3.8. Let P be a l-admissible partition. 

1. For every tower T — (A,M), if <f> is a (T, P,£,e) -repainting data 
with associated partition Q, then A is measurable with respect to 

2. Ifh(T,P) > log a — 77, then ifT is sufficiently invariant and covers 
more than 1 — 77 of the space, then the probability that the partition 
Q associated with a random repainting data %p satisfies h(T, Q) > 
log a — 77 is greater than 1 — 77. 

Proof. The first claim follows from the fact that z £ A if and only if 
P(z) = T and Q(T™ 1 2) = Q(T~ 2 z) = . . . = Q{T~ 2l z) = 0. 

As for the second claim, define towers T old = (T e|T| A, (1 - e)\T\ - 21) 
and T°™ = (A,e\T\). By Theorem [2~4l there is a collection N of less 
than 2 ( - h( - T)+v) \ T "" l "\ (T new , P)-names such that the set of z £ A such that 
i/ T n™ p(z) £ J\f has measure greater than (1 — n)fi(z). 

Similarly to the proof of Lemma 13.51 there is a function $ : A — > 2 A ^ P 
such that 
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1. $(z) depends only on the (T° w , P)-name of T e|r| z. 

2. |$(z)| < 2( h ( T '- p )- loga + ? ')l T ° ! ' i l. 

3. The set of z G A such that v T oid iP (T E ' r 'z) G has measure 
greater than (1 — e)fi(A). 

By taking the product of $ and N ', there is a function ^ : ^4 — > 2^ p 
such that 

1. *(z) depends only on the (T° ,d , Q)-name of T e|t| z. 

2. |*(z)| < 2(' 1 ( T ' p )- log[l + , ')l' ro,d l+' l ( T ' p )l r """l. 

3. The set of z G A such that i*r p(z) G ^(z) has measure greater than 
(l-e)p(A). 

By Lemma 12.121 the probability that 

M {z G J 4||*(z)n0- 1 (0(^r,p(z)))| < 2 (' l ^ p )- loga +'')l roi£i l+(' l ( T - p )- lo ^)l r " <!,u l} > (1-„) M (A) 

is greater than 1 — r\. In this case, since z i— > ^f(z) n </> _1 (<^(z/t,.p(z))) is 
V-oc T^-measurable, Lemma 12771 says that h(T, P\ V T ; Q) < h(T, P) - 
log a + rj, which proves the claim. □ 

4 Proof of Theorem 11.21 

Let (Z, Tz = Tx VTy, At, T) be as in Theorem 1 1.2 1 By Krieger's theorem, 
there are generating partitions Px and Py for Tx and J-V respectively. 
Let eo > be such that h(T) < log a + log 6 — eo. 

The first part of the proof of Theorem 11.21 is to obtain a pair of parti- 
tions that are close to generate, in the following sense: 

Definition 4.1. A pair of partitions (Px,Py) is called (e,5)-good if 

1. The partition Px is T x -measurable and has a parts; the partition 
Py is Ty -measurable and has b parts. 

2. Px C V-oo T '( p x V Py), and P Y C V-oc T\P X V P Y )- 

3. h(T,P Y ) > logfe-eo- 

A pair of partitions (Px, Py) is called (e, S) -very good if it is (e, 5) -good 
and, in addition, h(T,Px) > log a — eo. 

Note that if an (e, (5)-good pair exists, then h(T,Ty) > log fa — eo. 
Similarly, if there is an (e, <5)-very good pair, then also h(T, Tx) > log a — 
eo- 

Proposition 4.2. Assume that h(T,Ty) > log 6 and h(T,Tx) > log a. 
Then for every e > 0, there is a pair of partitions (P x ,Py) which is 
(e, e)-very good. 

Proof. Choose r\ > such that 

h(T\T x ) + 2 V <\ogb 

and 

2 V (log\P Y \ + l)+H(ri) <e 



and 

h(T) < log a + log 6- H{rj) - 2r?(log \Py\ + 4). 
Choose I such that 

log b- 77 < lim ilog|^4(n — 6)1 

and 

log a — 7; < lim — log |_4(n — ^, a)|. 

n — >ao 72 



1. Choosing the Tower S: By Theorem 12.41 and Corollary 12,61 if S is 
an invariant enough tower with base A that covers more than half 
of the space, then there are 

• A collection JV C Afs of size 2 |s| W T '^ i ' )+ '' ) . 

PY 

• A function $ from Afs to subsets of Afs of size 2 |s|( ' i(T| ^ x)+ ' j) . 

Px Py 

such that the points z £ A for which 

"iAW6^ (3) 

and 

^s.jyO) e $ o(^p x (z)) (4) 
has measure greater than (1 — rj)fi(A). Choose such a tower S that 
is measurable with respect to Ty , covers 1 — 77 of the space, and such 
that |<S| satisfies 

1+ v\\A(\S\-l,£,b)\) <2 (5) 

and 

2. Choosing the Partition Py : Choose a random function / : IPy]' 5 — > 
-4(|S| — £,l,b), and let Py be the partition obtained by painting / 
on S. It is clear that Py is J^V-measurable. Define a function $1 
from \Py\ ]S] to subsets of |Py| |51 by 



$i(n) 



f-\n) C\N \r 1 {n)nU\ < 2 l' s IW r ^v)-iogi>+2<,) 
else 



and a function * from \P X x Py| |51 to |P X x Py| |s by 

* (n m) = lr\m) n *o(n) ir^m) n <&o(n)| = 1 
|_ undefined else 

By Lemma 12,121 and inequalities (JSJ) and (O, most paintings satisfy 
that for all but 2r/ of the points z in A, 

«'s I fv(*)e*i(«'s,ivW). (7) 

and 

^,p xX p y (2) = *(^,p xX P y W). (8) 
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By Lemma 12.71 we get that 
h{T,P Y \\jT l P Y ) <h{T,f Y )-\o g b + 2 V + H(r l ) + 2r l log\P Y \. (9) 

In particular, h(T, Py ) > log b — 2r\ — H(rj) — 2rj log \Py\ > log b — e . 

3. Choosing the Tower C: By Corollary 1 2 . 6 1 and Equation @ , if C is an 
invariant-enough tower with base B, then there is a function $2 from 
\P Y to subsets of |/V| |£| of size 2 l £ KMT,^)-iog o+2^(io g |iv |+2)+ff(„)) 
such that for all but ^-portion of the points of B, 

y c ,p Y { z )^^c,p Y {z)). (10) 

Also, by making C more invariant and using Corollary 12,61 we can 
assume that there is a function $3 from |Py|'' c ' to subsets of |Px|' £ ' 
of size 2' £ ' (h(T ' :ri ' )+ ' 7) such that for all but ^-portion of the points 2 
in B, 

^W^s^ivW)- (11) 

By composing $2 and $3 we get a function $4 from ] P Y \ ' c to subsets 
of |P A -| |£| of sizes 2 l £ KMT)-iog i) +2^(io g |^|+3) + H( 17 )) guch that for aU 

but 2?7-portion of the points z in B, 

^AWe*3kp r W). (12) 

Finally, we require that C is Tx -measurable and \L\ satisfies 

logL4(|£|-^,a)l > |£|(loga-7/) (13) 

4. Choosing the Partition Px: Choose a random function g : |P\-|' C — > 
-4(|£ — £,£,a), and let Px be the partition obtained by painting g 
on the tower C. It is clear that Px is .T-x-measurable. Define a 
function $5 from \P X X Py| |c| to \P X X Py| |£| by 

(p _1 (n) n $ 4 (?Ti),m) |5 _1 (n) n $4(m)| = 1 
undefined else 

By Lemma 12,121 there is a function g as above such that for all but 
3?7 of the points in B, 

v c,p x xp y ( z ) = ®h(vc,p x xp y (z)). (14) 

5. Conclusion of the proof: For all but 2n of the points z £ Z, z is in 
the image of both C and S. Assuming this is the case, by looking 
at the Px-name of z we can find the smallest non-negative num- 
ber i such that T~ l z € B. Denote w = T~ % z. Similarly, the P Y - 
name of z determines the minimal non-negative integer j such that 
T~ j z £ A. Denote u = T~ J z. The P x x Py-name of z deter- 
mines vc,p x xp y (u), and hence, for 1 — 3n of the points, determines 
Vp p.(u) = $s(i'£.p x xPy(i))- Let now j be the smallest non- 
negative number such that T~ 3 z £ A. The tuple vp xP (u) de- 
termines v s p xX p Y (T~ 3 z) and so for 1 — 77 of the points determines 

v s,p x xp y ( T ~ J z ) = *(Vxxjv( T_3z ))' This ' clearl y- determines 
Px(z) and P Y (z). 



$5(n,m) 



IC 



□ 

The second part of the proof of Theorem 11.21 is to improve the pair 
(Px,Py) and make it "more generating". 

Definition 4.3. Given e, S > 0, let 

He, S) = 2- {e)+ H{5) + e log lPx \+ Slo &\ p r\ 



log a + log b - £ - h(T) 

Note that as e, 5 tend to 0, the function f(e, S) tends to 0. 

Proposition 4.4. If e,5 > are small enough then the following hold: 

1- If (Qx,Qy) is (e,8)-good, then for every r\ > there is a partition 
Px such that {Px,Qy) is (j],28)-good, and \Px^Qx\ < f(e,S). 

•8- If {Qx, Qy) is (e, 5) -very good, then for every rj > there is a par- 
tition Px such that (Px,Qy) is (rj,2S)-very good, and \PxAQx\ < 
f(e,5). 

Proof. We can assume that e, 8, and f{e,S) are less than 1/2. There is 

a number TV such that P Y C \f1 N t \Qx V Q Y ), and Qx C V-at T'Px- 
We can assume without loss of generality that 4Nn < 5 and that 

fU « > H(e)+H(S) + elog\?x\+5\og\PY\+ r, 
J( ' ' loga + logb-e -h(T)-2ri 

Choose I such that 

lim — log \A(n, £,a)\ > log a — n 

n — >oo n 

By changing Qx slightly (and enlarging t if needed), we can also assume 
that Qx is ^-admissible. 

In order to construct the partition Px , we choose a tower T = (A, M) 
which is jTx-measurable and covers more than 1 — r\ of the space, and re- 
paint the first /(e, 5)\T\ levels of it using a random function ip : \Px\ —* 
A(£, f(e, S)\T\, a). We will show that if T is taken as sufficiently invari- 
ant, then with high probability (on tp), the obtained partition — which we 
denote by Px — is good. By Lemma 13.71 \Px^Qx\ < f(e,5) +n. 

Given T, define the towers T old = (T^ e ' s ^A, (l-/(e, 5))\T\-2l) and 
T™ = (A,f(e,S)\T\). As |T| oo, the towers T old and T"™ become 
more and more invariant. Note that both cover more than f(e, S)/2 of the 
space if \T\ is invariant enough, and that v ro id p x (z) = v ro id q x (z) for 
every z G T /(e ' a)|T U. 

Applying Proposition 12 . 1 1 1 to the pairs (Px, Qx V Qy) and (Py, Qx V 
Qy), if T is invariant enough, then there is a function "I>i : Mq x \iq y — > 
2^v?y suc h that for any z G T /(e ' ,s),T U, the set $i(fr»",Q Y v(3 r ( z )) 
has at most 

2 (H(e) + H(S)+e\P x \+S\P Y \+ v )\T\ 

elements, and the set of z G j n /( e .< 5 )l T l ^4 f or w hich v T oid p xV p Y (z) G 
&i(y T <,id t Q x yQ Y (z)) has measure larger than (1 — n)fi(A). 
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By Corollary 1 2 . 61 applied to the pair (Qy, Py), if T is invariant enough, 
then there is a function $2 : A/q v — » 2 p y such that for any 2 £ A, the 
set $2(i / T' ie ™,Q y (2)) has at most 

gOCT.JPy ) -log 6+60+17) 1^""" I 

elements, and the set of z £ A such that v Tnew p Y {z) £ $2(^T" e "',Q i , (2)) 
has measure greater than (1 — 

Applying Corollary 12, 6l to the pair (Px, Py), if T is invariant enough, 
then there is a function $3 : Mp — ► 2 such that for every 2 £ j4, the 
set $3(7/ T „ ctu p r («)) has at most 

2 (h{T\T Y ) + r,)\T^ 

elements, and the set of z £ A such that u Tncm p (z) £ ^2{y TnKW pyC 2 )) 
has measure greater than (1 — r])n(A). 

Let $4 be the composition of $3 and $2- Combining $1 and $4, we 
get a function $5 : Mq x x Nq y — * 2 such that for every 2 £ A, the 
set $ 5 (^T°",Q x (r /(E ' 5)|T| T2),7/T,Q y (2)) has size at most 

2 {H{ i ) + H(8) + i \P x \+8\P Y \+f(E,S)(h{T)~lo e b+t )+3 v )\T\ 

and the set of 2 £ A such that 

7^(2) £ <S> 5 (v rold , Qx (T f ^^Tz),VT, QY (z)) 

has measure greater than (1 — 2r))[i(A). 
Note that if |T| is large enough, then 

2{H(t) + H(5) + t\P x \+6\P Y \+f( t ,6)(h(T)-l os b+ t0 )+2 v )\T\ 

< 



\A(f(e,8)\T\,£,a)\ 

_ 2 (H( E ) + H(«) + E|P x |+<5|Py|+/(e,<5){h(T)-log6-loga + E o) + 3r,)|T| _^ q 

as |T| — ► 00. Applying Lemma [2.12l to the functions ^s(v T oid > Q x (T^ e, ^ T ^Tz), vt n Y (z)), v r g (z), 
and the random coloring -(/>, we get that with high probability on ip, the 
set of points 2 £ A for which the intersection 

$ 6 ( 2 ) = $5^^ (T /(E - 4)|T| T2), 7> T , Qy (2)) n (2)) 

is a singleton has measure greater than (1 — 3t;)/^(A). 
We claim that 

477 



Px C \/ T'iPxVQy 



Indeed, let = V-<x> Ti ( p x V Qy). By Lemma EH] the set A is 0- 
measurable, and so is the function /3 : Z — > Z that sends 2 £ Z to 
the largest non-positive integer i such that T l z £ A. The ^-measurable 
partition 

/ (<E> 6 (r ,3(z) 2))-/3( z ) if /3(z) > -M and $ 6 (z) is a singleton 
2 ^ 1 else 
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coincides with Px for all but 1 — 4?7 of the space. 
As for Py, we have that 

N N 2N N 

Py C V T l Qx V \J TQ Y C \/ T l Px V \J T l Q Y C 5 

-N -N -2N -N 

and so 

~ i5+6JVri 

Py C g. 

Finally, if h(T,Qx) > log a, then by Lemma 13.81 if T is sufficiently 
invariant, the entropy h(T, Px) is greater than log a with high probability 
on the random function ip. □ 



Proof of TheoremUM If h{T,T x ) < log a and h(T,T Y ) < log 6, then by 
Krieger's theorem there are partitions Px and Py that are Tx and Ty 
measurable, have a and b parts, and generate Tx and Ty respectively. 
We assume in the following that this does not hold. 

Choose £o such that Proposition 14.41 applies to the pair (2£o,2£o)- 
Inductively choose a decreasing sequence such that both the sums 
J2 n and J2 n /(£n+i;2£n) converge, where / is defined in 14.31 

If h(T,Tx) < log a and Ii(T,Ty) > log 6, then by Krieger's theorem 
, there is a generating partition Px to Tx- We define a sequence of 
partitions Py as follows: by Proposition 14.21 there is a pair of partitions 
(Px,P Y ) that is (Co,?o)-good. It follows that (Px,P°) is also (Os- 
good. Assuming Py was defined, applying Proposition 14.41 there is a 
partition P£ +1 such that (P x ,Py +1 ) is (0, £„+i)-good and jPyAP£ +1 < 
/(0,£n) < /(£„,£«)• Therefore £ n \P?AP£ +1 \ < oo, so there is a limit 
partition Py°. it follows that (Px,Py°) satisfy the requirements of the 
theorem. The same proof holds if h(T,Ty) < logb and h(T,Tx) > log a. 

Assume finally that h(T,Tx) > log a and h(T,Ty) > log 6. We de- 
fine a sequence of pairs of partitions (Px,P Y ) as follows: by Proposition 
14.21 there is a pair of partitions (Px,Py) that is (£o,£o)-very good. As- 
suming (Px,Py) have been defined and the pair is £n)-very good, 
applying Proposition 14.41 there is a partition P x +1 such that (P_£ +1 ,Py) 
is (Cn+i/2, 2£n)-very good and \P X AP% +1 \ < /(£„,£„). Applying Propo- 
sition [474] again, there is a partition Py +1 such that the pair (P x +1 , Py +1 ) 
is (£ n +i,£n+i)-very good and |PyAP™ +1 | < /(fn+i,2£ n ). Since by defi- 
nition of the Cn's, the sums £ |P£AP™ +1 | and £ |PyAP™ +1 | converge, 
there are limit partitions Px and Py°. The pair (PjP,Py°) satisfies the 
requirements of the theorem. □ 
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